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Deputy  Chief  of  Staff  for  Personnel  -  Headquarters,  Department  of  the  Army  develop 
and  implement  a  personnel  strategy  that  will  enable  the  Army  to  attract,  train, 
reward,  and  retain  quality  civilian  and  military  T&E  personnel. 
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ISSUE  #2:  MANAGEMENT  PROCESS 
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EGLIN  AFB  HAS  A  FACILITY,  WITH  A  TOWER,  FOR  TESTING  SMART  MUNITIONS  AND  NOW  MICOM  IS 
BUILDING  A  SIMILAR  FACILITY. 
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THE  ARMY  DESIGNATE  A  MANAGEMENT  CONTROL  POINT  FOR  COORDINATION  AND  INTEGRATION 
OF  ALL  ARMY  T&E  INSTRUMENTATION  REQUIREMENTS. 


APPENDIX  A 


DEPARTMENT  OF  THE  ARMY 
OFFICE  OF  THE  ASSISTANT  SECRETARY 

WASHINGTON.  DC  20310  0103 

3  0  DEC  1987 


Mr.  Gilbert  F.  Decker 

President  and  Chief  Executive  Officer 

Penn  Central  Federal  Systems  Company 

1800  Diagonal  Road 

Suite  500 

Alexandria,  Virginia  22314-2840 
Dear  Mr.  Decker: 

You  are  requested  to  appoint  a  panel  of  15-18  Army 
Science  Board  Members  to  conduct  a  Summer  Study  during 
1988  on  Army  Testing.  The  study  should  address,  as  a 
minimum,  the  terms  of  reference  (TOR)  described  below; 
however,  the  panel  should  consider  the  TOR  as 
guidelines  and  not  be  inhibited . from  considering  other 
issues  regarding  Army  Testing  that  it  deems  as 
important. 

I.  BACKGROUND:  <n 

4s 

The  Army  has  evolved  its  test  program  for  material 
and  systems  over  many  years.  On  the  surface,  the 
program  follows  DOD  guidelines,  policies,  and 
regulations.  The  program  is  really  a  "collection  of 
programs",  codified  in  many  different  Army  documents 
and  regulations.  The  ultimate  objective  of  this 
ensemble  of  programs  is  to  provide  valid  sets  of  test 
data,  interpretations  of  test  data,  and  evaluations  of 
test  data  so  that  the  Army  can  make  sound  decisions 
throughout  the  life  cycle  of  a  material  program;  these 
decisions  range  from  early  on  testing  during 
preliminary,  feasibility  design  and  development  through 
operational  testing  to  determine  if  a  system  or  a 
product  improvement  to  an  existing  system  should  be 
produced  and  fielded  to  "in-use"  testing  after 
fielding.  Many  resources  (manpower,  dollars,  and 
organizations)  are  devoted  to  this  process.  In  spite 
of  this  wealth  of  experience  and  "corporate  knowledge", 
the  Army  has  experienced  a  number  of  problems  in  the 
testing  of  major  systems  late  in  the  process,  during 
operational  testing  (OT) .  The  future  test  programs  of 
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the  Army  must  not  repeat  these  problems  if  the  Army  is 
to  meet  its  essential  development  and  acquisition 
objectives  in  the  ever  more  challenging  and  austere 
defense  economic  environment  of  the  next  decade.  The 
Army  leadership  (and  indeed  DOD,  Executive  Branch,  and 
Congressional  leadership)  could  benefit  greatly  from  an 
objective,  systematic  assessment  of  the  Army's  overall 
test  program (s). 

II.  STUDY  OBJECTIVES/TERMS  OF  REFERENCE 

A.  OBJECTIVES  -  The  overall  objectives  of  the 
study  are: 

(1)  to  provide  the  Army  with  an  assessment  of 
the  philosophy,  methodology,  and  effectiveness  of  its 
test  program; 

(2)  to  determine  what  the  Army's  test  program 
should  be  to  meet  its  material  acquisition  needs  for 
the  next  decade; 

(3)  to  recommend  methodology  (ies)  in  the 
conduct  and  quality  of  testing. 

B.  TERMS  OF  REFERENCE 

(1)  What  is  the  Army's  current  testing 
philosophy  and  testing  policy? 

(a)  What  is  the  basis  for  the  Army's 
testing  philosophy  and  policy? 

(b)  Is  it  consistent  with  development/ 
acquisition  policies? 

(c)  Are  the  implementing  instructions  and 
directives  consistent  with  policy,  clear,  and 
realistic? 

(2)  What  is  the  Army's  current  process  for  test 
planning? 


(a)  When  does  test  planning  begin  within 
the  "womb-to-tomb"  cycle"? 

(b)  Is  the  Test  &  Evaluation  Master  Plan 
(TEMP)  an  effective  vehicle  for  carrying  through  with 
minimum,  essential  testing?  Is  there  change  control 
discipline  that  allows  for  flexibility  as  requirements 
evolve? 
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(c)  Does  the  test  plan  approval  process 
provide  for  high  quality  and  knowledgeable  technical 
participation? 

(3)  What  is  the  Array's  current  process  for  test 
plan  implementation  and  conduct  of  testing? 

(a)  Are  there  test  organizations  with 
clearly  stated  authorities  and  missions? 

(b)  What  are  the  respective  roles  of  test 
agencies  development  agencies,  procurement  agencies, 
life-cycle  support  agencies,  and  contractors  in  the 
conduct  of  testing? 

(c)  Are  the  methodologies  and  technologies 
(procedures,  data  processing  techniques,  modeling  and 
simulation  techniques,  etc.)  used  in  the  conduct  of 
testing  up  to  date? 

(4)  Control  and  use  of  data,  interpretations, 
and  evaluations. 

(a)  How  are  data  requirements  established? 

(b)  How  are  data  validated?  Are  predictive 
models  used  and  variances  to  actual  data  explained  by 
both  statistical  and  engineering  analysis? 

(c)  How  are  test  data  used  in  the  decision 

process? 


(d)  Are  decision  "ground  rules"  established 
and  adhered  to? 

(5)  Based  on  the  analysis  and  review  of  the 
first  four  terms  of  reference,  what  specific  actions 
must  the  Army  take  to  insure  a  sound  test  program  for 
the  coming  decade? 

The  study  is  not  expected  to  be  classified, 
although  certain  material  up  to  DOD  Secret  may  be 
briefed.  The  study  is  expected  to  require  visits  to 
and  briefings  by  several  Army  RD&E  Centers,  AMC 
headquarters,  TRADOC  headquarters  and  agencies, 
development  test  agencies,  operational  test  agencies, 
field  user  commands,  OTEA,  and  senior  leaders  within 
Department  of  the  Army. 


A-4 


LTG  Donald  S.  Pihl,  Military  Deputy  to  the 
Assistant  Secretary  of  the  Army  (Research,  Development 
and  Acquisition) ,  will  be  the  Department  of  the  Army 
sponsor  for  this  study.  Mr.  Walt  Hollis,  the  Deputy 
Under  Secretary  of  the  Army,  Operations  Research;  Mr. 
Keith  A.  Myers,  Director,  USA  Materiel  Systems  Analysis 
Activity,  Aberdeen  Proving  Ground,  MD;  MG  Robert  L. 
Drudik,  CG,  USA,  TRADOC  Combined  Arms  Test  Activity, 
Fort  Hood,  TX;  MG  Charles  F.  Drenz,  CG  USA  Test  and 
Evaluation  Command,  Aberdeen  Proving  Ground,  MD;  and  MG 
Jerome  B.  Hilmes,  CG  Operational  Test  and  Evaluation 
Agency,  Falls  Church,  VA  will  serve  as  senior  advisors. 
MG  August  M.  Cianciola  will  serve  as  the  Cognizant 
Deputy.  COL  Hezekiah  M.  Richardson,  Office  of  the 
Assistant  Secretary  for  Research,  Development  and 
Acquisition,  will  serve  as  Staff  Assistant. 

The  group  should  begin  its  work  immediately  and 
conclude  the  effort  at  the  10-day  summarization  and 
report  writing  session  scheduled  for  18-28  July  1988  at 
the  National  Academy  of  Sciences  Study  Center,  Woods 
Hole,  MA. 

It  is  not  anticipated  that  your  inquiry  will  go 
into  any  "particular  matters"  within  the  meaning  of 
Section  208  of  Title  18,  United  States  Code. 

Sincerely, 


J.  R.  Sculley 

Assistant  Secretary  of  th£  Army 
(Research,  Development  and  Acquisition) 
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Permitting  more  test  repetition  and  thus  improve  measurement,  data  handling 
reduction,  and  statistical  confidence  levels. 
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P.L.  99-661 
Sec.  909 


LAWS  OF  99th  CONG.— 2nd  SESS. 


Nov.  14 


“23 $5.  Coapetithre  prototype  atritegy  requirement:  major  defeoae  acquisition 
programs.**. 

(b)  ErrEcnvx  Date. — Section  2365  of  title  10,  United  States  Code 
(as  added  bv  subsection  (aXD),  shall  apply  to  major  weapons  systems 
(as  defined  in  subsection  (cXD  of  sudi  section)  that  enter  the 
advanced  development  stage  after  September  30, 1986. 

SEC  tia  TESTING  OF  CERTAIN  WEAPON  SYSTEMS  AND  MUNITIONS 

(a)  Survivability  and  Lethality  Testing  and  Operational  Test¬ 
ing.— (1)  Chapter  139  of  title  10,  United  States  Code,  is  amended  by 
adding  after  section  2365  (as  added  by  section  909)  the  following  new 
section: 


“5  2366.  Major  systems  and  munitions  programs:  survivability  and 
lethality  testing;  operational  testing 

“(a)  Requirements. — The  Secretary  of  Defense  shall  provide 
that— 

"(1)  a  covered  system  may  not  proceed  beyond  low-rate  initial 
production  until  survivability  testing  of  the  system  is 

completed  in%5c6raance  with  this  section; 

*X2)  a  major  munition  program  or  a  missile  program  may  not 
proceed  ?!5w=¥ate  ’Initial  production  until  realistic 

lethality  testing  of  the  program  Is  completed  in  accordance  with 
this  section;  and  :  ^ 

"(3)  a  major  defense  acquisition  program  may  not  proceed 
beyond  low-rate  initial  production  until  initial  operational  test 
and  evaluation  of  the  program  Is  completed  in  accordance  with 
this  section*  •  v  • 

“(b)  Ter  Guidelines.-- (1)  Survivability  and  lethality  testa 
required  under  subsection  (a)  shall  be  carried  out  sufficiently  early 
in  the  development  phase  of  the  system  or  program  to  allow  any 
design  deficiency  demonstrated  by  the  testing  to  be  corrected  In  the 
design  of  the  system,  munition,  or  missile  before  proceeding  beyond 
low-rate  initial  production.  .  ... 

►  “(2)  In  the  case  of  a  major  defense  acquisition  program.no  person 
employed  by  the  contractor  for  the  system  being  tested  may  be 
involved  in  the  conduct  of  the  operational  test  and  evaluation 
required  under  subsection  (al  .  . 

^(3)  The  costa  of  all  tests  required  under  that  subsection  shall  be 
paid  from  funds  available  for  the  system  beingtested. 

“(c)  Waives  Adthokitt.— The  Secretary  of  Defense  may  waive  the 
application  of  the  survivability  and  lethality  tests  of  this  section  to  a 
covered  system,  munitions  program,  or  mwafle  program  if  the  Sec¬ 
retary,  before  the  system  or  program  enters  full-scale  engineering 
development,  certifies  to  Congress  that  live-fire  testing  of 
such  system  or  program  would  be  unreasonably  t expensive  and 
impractical  . 

“(d)  Waiver  m  Tna  or  War  oa  Hohuuhoh.-! In  time  of  war  or 
mobilization,  the  President  may  suspend  the  operation  of  any  provi¬ 
sion  of  this  section* 

“(e)  DrriNrnoNS. — In  this  section: 

“(1)  The  term  'covered  system*  means  a  vehicle,  weapon 
platform,  or  conventional  weapon  system— 

“(A)  that  includes  features  designed  to  provide  some 
degree  of  protection  to  users  in  combe  t;  and  . 

"(B)  that  is  a  major  system  within  the  meaning  of  that 
term  in  section  230^5)  or  this  title. 
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"(2)  The  term  'major  munitions  program’  means — 

"(A)  a  munition  program  for  which  more  than  1,000,000 
rounds  are  planned  to  be  acquired;  or 
"(B)  a  conventional  munitions  program  that  is  a  major 
system  within  the  meaning  of  that  term  in  section  2302(5)  of 
this  title. 

"(3)  The  tens  'major  defense  acquisition  program*  means— 
"(A)  a  conventional  weapons  system  that  is  a  major 
system  within  the  meaning  of  that  term  in  section  2302(5)  of 
this  title;  and 

"(B)  is  designed  for  use  in  combat 

"(4)  The  term  Ye&listic  survivability  testing*  means,  in  the 
case  of  a  covered  system,  testing  for  vulnerability  and  surviv¬ 
ability  of  the  system  in  combat  by  firing  munitions  likely  to  be 
encountered  in  combat  (or  munitions  with  a  capability  similar 
to  such  munitions)  at  the  system  configured  for  combat,  with 
the  primary  emphasis  on  testing  vulnerability  with  respect  to 
potential  user  casualties  and  taking  into  equal  consideration 
the  operational  requirements  and  combat  performance  of  the 
system. 

*1(5)  The  term  'realistic  lethality  testing*  means,  in  the  case  of 
a  major  munitions  program  or  a  missile  program,  testing  for 
lethality  by  firing  the  munition  or  missile  concerned  at  appro¬ 
priate  targets  configured  for  oombat. 

"(6)  The  term  'configured  for  combat’,  with  respect  to  a 
weapon  system,  platform,  or  vehicle,  means  loaded  or  equipped 
with  all  dangerous  materials  (including  all  flammabtes  and 
explosives)  that  would  normally  be  on  board  in  combat 

*W)  The  term  'operational  test  and  evaluation9  has  the  mean* 
ing  given  that  term  in  section  138(aX2XA)  of  this  title.”. 

(2)  The  table  of  sections  at  the  beginning  of  such  chapter  is 
amended  by  adding  after  the  item  relating  to  section  2365  (as  added 
by  section  909)  the  following  new  item: 

"2366.  Major  systems  mnd  munitions  programs:  sunorability  and  lethality  testing; 

operational  testing.**. 

(b)  Effective  Date.— Section  2366  of  title  10,  United  States  Code 
(as  added  by  subsection  (a)),  shall  apply  with  respect  to  any  decision 
to  proceed  with  a  program  beyond  low-rate  initial  production  that  is 
mde — 

(1)  after  May  31, 1987,  in  the  case  of  a  decision  referred  to  in 
subsection  (&X1)  or  (aX2)  of  such  section;  or 

(2)  after  the  date  of  the  enactment  of  this  Act,  in  the  case  of  a 
decision  referred  to  in  subsection  (aX3)  of  such  section. 

(c)  Time  roa  Submission  of  Annual  Report  or  Director 
(OT&E). — Subsection  (gXl)  of  section  138  of  such  title  (as  redesig¬ 
nated  by  section  101(a)  of  the  Goldwater-Nichols  Department  of 
Defense  Reorganization  Act  of  1986  (Public  Law  99-433))  is  amended 
by  striking  out  "January  15”  in  the  second  sentence  and  all  that 
follows  through  'is  prepared’  and  inserting  in  lieu  thereof  "10  days 
Ater  the  transmission  of  the  budget  for  the  next  fiscal  year  under 
•ection  1105  of  title  31” 
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couurmi  on  ami  to  stnvtcu 

Washington.  DC  20«  1O-40SO 


January  5,  1987 


Honorable  Caspar  W.  Weinberger 
Secretary  of  Defense 
Washington,  D.C.  20301 

Dear  Hr.  Secretary: 

In  the  Fiscal  Tear  1987  National  Defense  Authorization  Act 
(PL  99-661)  Congress  imposed  a  limitation  on  the  involvement  of 
contractor  personnel  in  operational  test  aod  evaluation  (OTIC)  of 
major  conventional  systems  designed  for  use  in  combat.  Under  this 
limitation,  no  personnel  employed  by  the  contractor  for  a  systea 
being  tested  *may  be  involved  in  the  conduct  of*  the  test  or  the 
evaluation  of  the  results  of  that  test. 

^  Ve  understand  that  a  clarification  of  the  Intent  of  this 
provision  would  be  helpful  to  OSD  and  Service  test  agencies  in 
planning  for  future  OTAE.  It  is  our  intention  to  ensure  that, 
during  operational  tests,  weapon  systems  art  operated, 
maintained,  and  otherwise  supported  by  personnel  typical  of  those 
who  will  carry  out  such  duties  when  the  systea  is  deployed  in 
combat.  It  is  our  further  intention  that  the  processing  and 
evaluation  of  test  data  be  carried  out  la  a  completely  objective 
■anner  with  no  possibility  or  even  the  appearance  of 
system-contractor  manipulation. 

Therefore,  under  the  limitation  established  by  PL  99-661, 
system-contractor  personnel^A^M  involved  in  an  operational  tes‘ 
ftniT  to  the  extent  that  ls(^planDed)for  them  to  be  Involved  in  the 
operation,  maintenance,  anJ^athef^upport  of  the  system  being 
tested  when  that  system  is  deployed  im  combat.  Ve  would  expect 
that  very  few,  if  any,  conventional  combat  systems  as  defined  in 
PL  99-661-  will  entail  such  post-deployment  contractor 
Involvement.:*  Thus,,  few,  if  any,  operational  tests  wlll~entsll  an: 
sort  of  system-contractor  participation. 


As  for  processlnc  »nd  evaluation  of  test  data,  we  believe  1 
is  dear  that  systea-contractor  personnel  are  coapletely  and 
properly  excluded  froa  such  activities  by  the  provisions  of  FI 

f  yJ  hop\that  this  clarification  is  helpful  to  you. 


Sincerely, 


ilWtip 

Clairaan  | 

House  Cooaittee  on 
Aroed  Services 


9  Barry yGpTtivater 
Chalc hCrJ 

SeaaC£/o»mittee  on 
Araed  Services 
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DEPARTMENT  OF  THE  ARMY 
OFFICE  OF  THE  ASSISTANT  SECRETARY 

WAtHINOTON,  DC  MHO 


lUt^ZI  13  June  1988 

KEMOmUTOUM  Foil  tn  dibtiibutioh 

SOBJSCTi  Sjitn  Contractor  Participation  to  Technical  Test  Scoring  Conferences 
and  Fallibility,  Availability,  Mi  Maintainability  (1AM)  Asiseesent  Conferences 

1.  Tbi  purpose  of  i  scoring  essfirtsu  la  to  establish  a  teat  data  baaa, 
assuring  that  a  proper  aod  consistent  determination  la  msda  for  cattgorising 
teat  incidents  agalnet  1AX  requiraments.  This  requires  as  understanding  of  the 
fuoetlos  lost,  the  consequences  thereof  os  eystet  minion  accomplishment,  aod 
•o  understanding  ee  to  eauae  ao  that  loeideats  can  be  properly  categorised  Into 
hardware,  software,  operator  error,  maintenance  error,  manual  deficiency, 
accident,  etc. 

2.  It  la  thue  recognised  that  scoring  of  teat  incident!  suit  be  aecoapliehed 
with  knowledge  of  ceuae  end  effect,  and  that  the  beat  aourca  of  much  of  this 
knowledge  la  the  dewelopneot/noadewtlopmeatel  Item  (KDI)  system  contractor.  It 
la  alao  recognlted  chat  thle  knowledge  muet  be  gleened  In  aueh  a  manner  ae  to 
avoid  undue  influence,  or  the  perception  of  undue  influence,  by  the  ayetem 
contractor  on  tha  acorlng  of  teat  incldanta  by  the  acoring  conference  seabera. 
Undua  influence  nan  be  avoided  through  proper  conduct  of  the  conference  by  e 
strong  chairmen;  proper  conduct  lapliee  thet  the  .ayatea  eontreetor  provides 
information  only  whan  requested  end  Unite  discussion  to  tha  technical  eapecta 
of  cause  end  effect.  Unfortunately,  the  perception  la  not  at  easily  avoided. 

3.  The  following  le  the  Army  policy  with  regards  to  systaa  contractor  partic¬ 
ipation  In  technical  teat  and  evaluation  activities! 

"The  participation  of  ayatea  contractor  personnel  at  scoring  conferences 
vill  depend  on  the  type  of  conference  being  held  -  technical  test  (TT)  or 
initial  operational  teet  and  evaluation  (10TE).  Since  10TT  la  conducted  for 
purpose  of  testing  under  realistic  field  conditions,  no  person  employed  by  the 
ayetem  contractor  for  the  system  being  tested  may  be  involved  in  tbe  conduct  of 
the  JOTS,  emeept  to  tbe  extent  they  are  involved  le  tbe  operations,  maintenance, 
mod  other  support  of  the  ayetem  when  it  it  dtployod.  fyatam  contractor 
paraonoal  mill  mot  be  participants  or  observer#  at  XOTf  acorlng  conferences* 
Dissuasions  with  system  contractor  personnel  say  be  naceassry  to  anaura  full 
technical  understanding  of  teat  incidents;  however,  discussions  with  system 
contractor  personnel  will  he  held  separate  from  tbe  scoring  conference*  A 
formal  written  record  will  ba  kept  by  tha  project  manager  of  all  aaparaen 
governsent/ayatam  contractor  dlscuaalona  of  test  incldanta  to  include  issues, 
ayatea  contractor  positions,  casual  analysis,  and  any  other  pertinent  data* 

normally,  TT  or  technical  tasting  ia  conducted  to  achieve  reliability,  avail¬ 
ability,  maintainability-durability  (kAM-fi)  maturity  and  at  such  can  only  occur 


SARB-ZB  13  June  1988 

SUBJECTi  fjittt  Contractor  Participation  in  Technical  Taat  Scoring  Confaroneaa 
an d  Reliability,  Availability,  and  Maintainability  (UK)  Asseesment  Confaroneaa 

if  tba  teatlni  la  designed  to  find,  analyst,  fit,  and  verify  problem*  through 
representative  seating  In  a  timely  manner.  Tbeae  factora  auggeat  that  engineer¬ 
ing  level  dieeueelone  with  aystea  contractor  personnel  are  eneouraged/requlred. 
Tbeae  discussions  should,  la  general,  take  plaee  prior  to  or  during  the  ecorlng 
conference.  Contractor  personnel  should  MOT  be  physically  present,  however, 
during  tbs  fonsal  voting/scoring  period.  The  aystea  contractors  should  speak 
primarily  et  the  rtquett  of  the  material  developer  spokesman.  The  chairman 
mill  he  responsible  for  maintaining  reasonable  participation  by  all  observers. 

In  those  TT  cases  where  it  it  known  that  testing  will  be  conducted  under 
conditions  similar  (operation  mode  summary  (OK8)/misii©n  profile  (HP),  stresses, 
environmental  conditions,  tsst  support,  fixed,  end  sene  configuration)  to  10TE, 
and  an  operational  test  it  to  be  conducted  during  the  seme  phase,  the  U.8.  Army 
Operational  Test  and  Evaluation  Agency  (OTEA)  will  notify  tho  U.S*  Army  Material 
Command  (AMC)  that  tba  TT  reaults  ere  to  be  combined  with  XOTE  results.  If 
agreed  to  by  AMC,  aystea  contractor  participation  in  the  TT  scoring  conferences 
will  be  the  seat  aa  for  I0TE  scoring  conferences." 

A.  This  policy  applies  to  major  acquisition  progress  only  and  will  be  refleeted 
In  Appendix  C,  paragraph  C-9,  entitled  "Participation  of  Systea  Contractor 
Personnel,"  in  the  ready  for  publication  draft  of  the  revised  Aft  702*3  (Army 
Materiel  Systems  Reliability,  Availability,  end  Maintainability),  and  in  Aft 
70*10  (Tast  and  Evaluation),  and  Aft  71*3  (User  Teat)  in  the  near  future. 
Addressees  art  expected  to  give  this  policy  imaediete  end  vide  dissemination. 

DONALD  g*  PZIL,  lieut/oeat  General,  USA 
Military  Deputy  to  the 
Assistant  Secretary  of  tba  Army 
(Research,  Development  and  Acquisition) 
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DEPARTMENT  OF  THE  Ai  h'V 

UMl  GO  STAT  ;‘j  ARMY  OPERATIONAL  TEST  AND  CVALU*.  )  ION  AGENCY 

5600  COLUMBIA  PIKE 
FALLS  CHURCH.  VIRGINIA  2200-5115 


14  January  1988 


MEMORANDUM  FOR: 

VICE  CHIEF  CF  STAFF,  ARMY 
/UNDER  SECRETARY  OF  THE  ARMY 

SUBJECT:  Retiring  Officer  Comments 

1.  This  memorandum  is  intended  to  provide  end-of-tour/retiring  officer 
comments  by  the  undersigned  who  will  retire  as  the  Commanding  General  of  OTEA 
after  32  1/2  years  service  effective  1  February  1988.  In  it,  I  wish  to  provide 
my  personal  views  on  several  topics  within  the  area  of  test  and  evaluation 
which  I  view  as  potentially  troublesome  and  to  present  my  personal  assessment 
of  the  health  of  my  command. 

2.  Potential/Continuing  Problem  Areas.. 

a.  Determining  System  Readiness  for  Operational  Test:  A  continuing 
problem  for  OTEA  has  been  an  accurate  judging  of  systems '  readiness  to  enter 
record  operational  testing.  This  becomes  increasingly  more  critical  in  a  time 
of  dwindling  resources  as  the  poor  showing  of  a  system  because  it  was  not  ready 
is  wasteful  and  further,  can  cause  premature  termination  of  the  program.  It 
must  become  a  first  principle  that  we  should  not  test  any  system  before  its 
time  no  matter  what  the  pressures  are  to  rush  into  test.  The  systemic  factors 
in  my  opinion,  which  contribute  to  premature  testing  fall  mainly  into 
two  categories:  inadequate  combat  development  test  preparation  and  an 
inability  to  gauge  software  development  status. 

(1)  Conbat  Developments  Test  Preparation.  On  several  occasions, 

{e.g.,  RPV,  JTIDS,  M1A1) ,  the  Army  has  entered  testing  without  doing  its  force 
structure,  tactics/doctrine  and  training  homework.  It  seems  patently  obvious 
that  dramatically  new  capabilities  are  going  to  be  fought  differently  from 
systems  they  replace.  New  systems  also  will  cause  us  to  fight  differently 
those  complementary  systems  which  they  fall  in  beside.  And  for  totally  new 
systems,  we  mist  develop  new  doctrine.  Despite  this,  we  have  gone  into  tests 
without  examining  beforehand  the  way  we  intend  to  do  business.  Forex 
Development  Tests  and  Experimentation  (FETE)  during  which  we  try  out  new 
tactics,  organizational  structures  and  command  and  oontrol  and  measure  the 
adequacy  of  training  before  testing  for  record  should  be  the  rule.  General 
Thurman  is  working  this  theme  within  TRADOC  and  I  feel  we  vri.ll  show  great 
improvement.  Nevertheless,  there  will  continue  to  be  problems  unless  we 
strongly  resist  pressures  to  test  by  a  schedule  rather  than  by  total  system 
readiness. 


BUY  US  SAVINGS  BONDS  THROUGH  THE  PAYROLL  DEDUCTION  PLAN 
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(2)  Software  Development  Status.  Software-based  systems  are  seldom 
adequately  tested  during  engineering  tests  prior  to  operational  test.  What  SW 
testing  that  is  accomplished  is  most  usually  single-thread  and  not  under 
stressful  loads.  Often  independent  verification  and  validation  is  not  a  part 
of  the. development  strategy.  Further,  the  metrics  used  during  development 
focus  on  schedule  and  resource  control  rather  than  software  quality. 
Consequently,  these  systems  almost  invariably  bring  surprises  some 
show-stoppers  ...  during  operational  test.  The  development  and  test 
communities  have  tried  several  new  approaches  to  avoid  these  problems.  ASAS 
and  MCS  have  used  something  called  the  "Software  Readiness  Verification  Test" 
which  would  appear  to  be  a  misnomer  since  both  systems  passed  these  gates  only 
to  fail  miserably  during  Operational  testing.  On  MSE,  OTEA  has  expended 
unprecedented  resources  to  track  development,  witness  contractor  in-plant 
tests,  fight  for  more  stressful  loading  of  the  system  in  the  contractor's 
facility  (even  to  the  point  of  providing  our  FOTE  instrumentation  and 
traffic-loading  devices)  and  to  challenge  contractor  test  results  that  do  not 
appear  as  "rosey"  as  he  reported.  OTEA  is  not  staffed  for  this  degree  of  C2E 
in  numbers  or  skills;  we  have  utilized  additional  contractor  support  under  our 
Qnnibus  contract  but  at  a  price  tag  of  nearly  $1M.  I  believe  that  our  efforts 
have  made  a  difference;  I  see  us  going  into  MSE  POTE  with  high  probability  of 
success.  But  such  an  effort  cannot  be  sustained.  I  can  offer  no  solution  to 
this  problem;  I  do  not  believe  quality  cannot  be  tested  into  software.  It  nust 
be  designed  and  built  in  a  priori.  Until  it  is,  the  Army  can  expect  a 
continuing  problem  on  these  systens. 

b.  T££iL_apd_Emluatic>ri  Has tex.Plans.  J TEMPI .  The  TEMP  is  supposed  to 
detail  a  T&E  road  map  for  the  system  by  defining  a  continuum  of  integrated 
contractor,  engineering  and  operational  testing.  A  TEMP,  therefore,  would  . 
appear  to  be  an  absolute  necessity  for  a  disciplined,  orderly  development. 
Surprisingly,  by  AMC  count  for  the  last  TSARC,  only  about  1/3  of  the  450+ 
systems  under  development  have  such  a  document.  Approximately  another  third 
have  a  TEMP  in  draft  form.  For  tie  others,  TEMP-status  is  unknown.  This  is 
despite  an  AMC  edict  several  years  ago  that  ro  acquisition  strategy  would  be 
approved  without  an  accompanying  TEMP.  The  lack  of  a  TEMP  carries  obvious 
penalties:  test  activity  work  load  cannot  be  programmed  and  scheduled  with  any 
accuracy;  priorities  for  testing  cannot  be  established;  instrumentation  cannot 
be  planned  accurately.  The  TSARC  has  attempted  for  the  past  year  and  a  half  to 
bring  attention  to  ard  resolve  the  TEMP  problem  but  without  success.  It  is 
anticipated  that  this  situation  wrill  get  worse  order  tie  EEO  system.  Neither 
OTEA  nor  BQ  AMC  will  have  any  visibility  into  the  systems  for  which  the  FEO  is 
the  TEMP  approving  authority.  A  first  order  of  business  for  the  SARDA  (with 
assistance  from  OTEA)  should  be  to  examine  the  staffing  and  coordination 
processes  for  TEMPs  ard  make  such  changes  as  are  necessary  to  provide  BQDA  ard 
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OTEA  cognizance  of  TEMP  status.  Along  this  line,  there  is  a  DCD  requirement 
for  annual  review  and  update  of  TEMPs.  No  one  is  managing  this  for  us  and 
consequently,  the  Army  is  habitually  late  with  revisions  ...  or  is  flat  V 
ignoring  the  requirement.  .  f\  .  . 


fictions 


c.  PL  99-661.  This  public  law  places  stringent  restrictions  on  contractor 
participation  during  and  in  the  handling  of  the  data  from  operation  testing. 
This  is  a  law  which  is  well-intended  and  on  its  face  makes  good  sense.  The 
intent  is  to  insure  that  systems  are  supported  during  test  as  they  will  be  when 
fielded  so-  that  accurate  support  ability  assessments  are  made  and  so  that  there 
,  is  no  opportunity  to  manipulate  test  data.  Everyone  has  to  support  these  aims 
...  they  are  motherhood.  Nevertheless  the  law  is  short  sighted  in  that  it 
leads  to  increased  test  costs  and  has  the  probability  of  causing  us  not  to  get 
nexinura  possible  value  out  of  the  tests  we  conduct.  As  examples,  we  normally 
5.  do  not  buy  enough  initial  systems  to  fully  implement  the  system's  logistical 
^  concept  during  operational  test;  we  do  not  normally  field  and  test  the  DS  or 
GS  levels  of  maintenance;  we  do  not  provision  with  spare  parts,  etc. ,  until 
after  a  procurement  decision.  We  seldom  train  the  maintainers  above  the 
organizational  level  in  the  initial  pre-test  training.  To  fully  comply  with 
the  law,  these  would  all  be  required  ard  they  carry  a  price  tag.  Additionally, 
a  trend  is  developing  in  which  we  require  the  contractor  to  deliver  the  system 
?for  test  with  an  instrumentation  package  included.  This  is  quite  often  unique 

i  t.iK n  /'Vi  t.  A  Kn:  vo  i  fir 


instrumentation  for  which  ve  have  no  maintenance  capability.  Contractor 
access,  then,  seems  the  only  solution  unless  we  want  to  train  a  soldier  for  a 
job  he'll  never  perform  except  during  test.  Lastly,  very  often  the  contractor 
is  tie  only  source  for  root-cause  analyses  of  test  failures.  Without  their  cm 

assistance  in  isolating  tailure  cause  and  impact  on  system’ performance ,  some  V 

failures  cannot  be  adequately  corrected.  These  are  but  a  few  of  tie  problems  ° 

which  cone  with  the  law.  I  would  urge  that  a  more  liberal  interpretation<Ce~>0 
aggressively  urged  on  Congress  by  tie  OT&E  leadership.  We  have  spoken  to  DOT&E  J 
or.  several  occasions  about  this.;  however,  I  do  not  believe  a  coherent  argument-^ 
has  been  presented  to  the  Congress.  I  believe  the  integrity  of  testing  and  , 

test  data  car;  be  perserved  even  if  the  contractor  is  allowed  more  ^ 

participation.  V V.  i , , 

Ck 

d.  T&E  Reorganization.  I  had  high  hopes  that  when  the  T&E  Reorganization  y 
was  approved  in  principle  pending  further  definition  and  planning  that  we  would 
rove  with  some  dispatch  to  do  this  work.  This  has  r.ct  hap  pored  and  I  am 
concerned  that  unless  all  preliminaries  can  be  finished  jorior  to  15  April,  a 
reorganization  plan  could  not  be  ready  for  final  approval  within  the  time 
remaining  for  the  current  administration.  Also,  I  do  not  believe  that  a 
reorganization  as  substantive  as  this  can  be  designed,  with  processes  defined 
and  responsibilities  documented,  by  part-time  command  representatives  without 
authority  who  meet  on  an  irregular  schedule.  The  preparation  of  an  adequate 
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Evaluation  Plan  for  a  major  system  takes  up  to  a  year;  a  Test  Design  Plan 
requires  6-9  nonths.  If  reorganization  were  approved  today,  it  could  not  be 
fully  implemented  until  at  least  1st  Otr,  FY  90.  This  is  an  effort,  in  ny 
opinion,  which  requires  the  full  time  attention  of  experts  for  a  45-60  day 
nonth  period  with  a  charter  to  develop  their  best  possible  product  and  a 
commitment  from  the  commands  involved  to  go  along  for  the  good  of  the  Army  no 
matter  what  "rice  bowls"  are  affected. 

3.  Health  of  the  Command.  As  I  depart,  I  assess  the  overall  health  of  OTEA  as 
strong  and  mission-capable.  We  have  a  strong,  increasingly-expert  civilian 
work  force  wto  provide  the  institutional  continuity.  The  authorization  for 
seven  additional  GS-15  grades  in  1986  was  the  best  thing  that  has  happened  to 
the  organization  in  years.  It  has  provided  increased  opportunity  for  promotion 
and  allowed  us  to  hire  a  senior  analyst  for  each  of  the  evaluation  divisions. 

The  people  we  promoted  or  brought  in  have  brought  great  benefit.  The  officer 
staffing  is  also  excellent  though  comparatively  it  is  not  as  experienced  or 
expert  as  the  civilian  component.  I  have  superb  captains  across  the  board, 
some  truly  outstanding  majors,  average  lieutenant  colonels  for  the  most  part 
and  solid,  competent  and  experienced  colonels.  We  have  had  good  success  on 
first  time  selection  to  major  but  lesser  success  above  that  grade.  OTEA  must 
continue  to  receive  high  priority  for  the  more  technically  and  operationally 
competent  officer.  I  lave  thought  several  times  of  the  similarity  of  the  OTEA  m 
mission,  as  your  C2E  watchdog,  with  that  of  the  old  AVice  shop.  We  ^ 

independently  evaluate  and  provide  you  an  assessment  unbiased  by  the  views  of 

the  staff  or  the  developers.  The  difference  is  that  the  Weapon's  System 
Evaluation  portion  of  the  AVice's  office  was  staffed  with  the  very  brightest, 
most  promising  that  the  Army  had.  C2E  is  the  way  to  go,  I  am  convinced,  but  it 
will  be  only  as  good  as  tie  people  in  OTEA.  Everything  can't  be  "Priority  1" 
in  this  Army',  I  realize,  but  a  better  cut  of  middle  grade  officers  is 
indicated. 

4.  I  have  truly  enjoyed  my  time  in  OTEA  and  I  thank  you  for  tie  opportunity  to 
serve  you  and  tie  Army.  This  is  a  great  Arn.y  and  as  I  told  General  Vbono  at  my 
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OFFICE  OF  THE  SECRET  Aft  V  OF  OEFENSE 
WASHINGTON  DC  203011  700 


MEMORANDUM  FOR  DISTRIBUTION 

SUBJECT:  Minutes  of  the  March  10.  1988,  Test  and  Evaluation 
Committee  (TEC)  Meeting 


The  meeting  agenda  is  at  Attachment  1  and  the  list  of 
attendees  is  at  Attachment  2. 

The  TEC  Chairman,  Mr.  Krings,  discussed  membership  and 
participation  at  TEC  meetings.  Total  TEC  membership  will^ 
include  one  senior  official  and  an  alternate  appointed  by’each 
organization  specified  in  the  TEC  Charter  (Attachment  3). 
Permanent  members,  expected  to  attend  all  meetings  will  be  JCS, 
ASD(C),  DDDR&E ,  AF  T&E  Executive,  Army  T&E  Executive,  Navy  T8E 
Executive  and  PAS.E .  Other  members  will  be  requested  to  attend 
when  their  areas  of  concern  are  subjects  of  discussion  or  they 
have  issues  to  present. 

Participation  in  TEC  meetings  will  be  limited  to  the 
principal  member  or  his  designated  alternate.  If  an 
organization  is  not  represented  at  two  cor.-^cutive  meetings  it  V 
will  be  removed  from  the  TEC.  TEC  meeting  will  be  decision  ° 
forums  with  detailed  information  provided  .n  a  read-ahead 
package  when  possible. 

Mr.  Tyler  provided  a  status  report  of  two  Live-Fire  Test 
(EFT)  Working  Group  efforts: 

1.  LFT  Guidelines — A  draft  of  the  LFT  Guidelines  has  been 
written  and  details  are  being  finalized.  Mr.  O'Bryon  will 
investigate  whether  the  Test  and  Evaluation  Master  Plan  (TEMP) 
is  the  proper  forum  for  OSD  approval  of  LFT  test  planning.  The 
LFT  Guidelines  will  be  available  for  staffing  in  one  month. 

2.  Improved  LFT  legislation — In  addition  t  -  the  LFT  Guidelines 
review  requested  by  the  TEC,  the  working  gr  up  has  taken  the 
initiative  to  propose  improved  LFT  legislat.on.  The  working 
group  will  submit  the  improved  legislative  language  to  the  TEC 
for  approval  and  request  that  it  be  submitted  to  Congress  in 
combination  with  the  legislative  language  provided  by  the 
Contractor  Involvement  in  OT  Working  Group.  Mr.  O'Bryon  stated 
that  OSD  may  not  be  in  agreement  with  sending  the  package 
forward  at  this  time  since  Congressional  staff  have  indicated 
that  this  issue  and  related  T&E  issues  would  not  be  taken  up  in 
this  session  of  Congress. 


operational  test 
asD  E  v  a  l  j  a  t  ON 


Dr.  Kimmel  provided  a  status  report  for  the  Realistic 
Testing/Modeling  and  Simulation  Working  Group  (Attachment  4). 

In  its  first  two  meetings  this  group  has  provided  definitions 
for  realistic  testing  and  modeling  and  simulation,  formulated 
categories  and  areas  of  concern,  and  defined  future  activity, 
to  include  impact  upon  DoD  policy,  implementation  strategy,  and 
fostering  DoD  support. 

Mr  Pflock  presented  a  status  report  for  the  Contractor 
Involvement  in  OT  Working  Group  (Attachment  5).  Conclusions 
are  that  the  current  language  in  10  USC  2366  is  unnecessarily 
and  unrealistically  restrictive,  creating  differences  in 
Service  implementation  and  causing  all  Services  to  be  in 
violation  of  the  law.  be 

Congress . 

Mr.  Bolino  provided  an  overview  of  the  T&E  budget 
(Attachment  6)  showing  little  growth  in  the  T&E  budget  in  the 
past  decade,  although  the  RDT&E  budget  has  almost  doubled.  The 
conclusion  is  that,  in  order  to  adequately  support  the 
acquisition  process  during  a  time  of  declining  defense  budgets, 
the  T&E  community  needs  to  improve  its  ability  to  project  the 
value  of  T&E  support.  Recommendations  are  that  the  TEC 
standardize  Service  terminology  and  budgeting  procedures  and 
take  an  active  role  in  management  of  the  a  ocation  of  T&E 
resources  for  the  FY90  POM. 

Mr.  Krings  announced  the  next  TEC  meeting  which  will  be 
held  on  April  1^  1988  in  Room  5D1033  from  1030-1 130am.  The 
topic  will  be  tUe  follow-up  to  Mr.  Bolino ‘s  presentation  on  the 
T&E  budget,  to  include  FY90-94  T&E  capability  investment 
needs.  Investment  pace  as  well  as  funding  approaches  will  be 
included  as  decision  options,  and  a  read-ahead  package  will  be 
provided  prior  to  the  meeting. 

Mr.  Krings  also  announced  that  a  T&E  Symposium,  hosted  by 
DOT&E  and  DDDR&E(T&E) ,  will  be  conducted  June  1 and  2,  1988,  in 
the  Washington,  D.C.  area.  The  primary  focus  Will  be* on  T&E 
issues  relating  to  acquisition  programs,  wi  h  topics  to  include 
TEMPs,  LFT,  and  early  OT  assessments.  The  program' will  be 
primarily  of  interest  to  senior-level  participants,  with 
representation  from  various  program  offices  and  the  field  test 
community. 


Attachments : 
As  Stated 


C-15 


On  Personnel 

Mr.  Krings  stre»s«4^tnat  tne  number  of  personnel  involved  in 
operational  testing  must  be  rWduced^ — He  stressed -The.  of 
computer-aided  testing  and  suggested  that  a  conference  could  be  held 
on  that  subject  in  the  future. 


On  Air  Defense  Threat  Simulators 

Mr.  Krings  stated  that  there  is  much  interpretation  of  what 
the  threat  simulators  should  be  and  there  is  a  need  to  consolidate 
requirements.  He  said  that  we  need  "a  comprehensive  view"  of  what 
the  threats  are,  the  real  threats,  and  the  simulators.  He  stated 
that  Congress  is  pushing  for  surrogate  and  simulated  threats.  He 
stressed  that  all  three  Services  need  to  be  involved  in  a  joint 
effort  because  all  have  the  same  threat.  He  further  stressed  that 
the  Services  need  to  get  an  agreement  on  a  common  threat  and  common 
requirements. 


On  Contractor  Involvement  in  OT 

Mr.  Krings  stated  that  we  must  take  a  reasonable  approach  to 
contractor  involvement  in  OT.  He  stated  that  first  of  all,  we  had 
to  realize  that  the  contractors  developed  and  produced  the  product, 
and  we  are  dealing  with  very  sophisticated  systems  today.  He^ 
stressed  that  we  cannot  afford  to  unnecessarily  duplicate 
sophisticated  instrumentation  systems  and  data  processing 
algorithms.  Mr.  Krings  emphasized  that  the  contractor  should  be 
allowed  limited  participation  as  long  as  assurances  are  made  that 
the  contractor  cannot  alter  the  test  outcome,  or  the  data,  or  how 
the  test  is  conducted. 


In  the  Support  Area 

Mr.  Krings  stressed  that  we  must  improve  ourselves  in  the 
support  area  to  testing.  We  must  become  more  efficient  by 
instrumenting  systems.  We  cannot  afford  to  pay  a  tester  to  monitor 
a  TV  screen  if  we  can  automate  data  collection  for  that  parameter. 

In  the  area  of  data  crunching,  Mr.  Krings  suggested  sharing 
capability.  He  stated,  "Don't  go  to  test  without  first  going 
through  the  simulation  and  modeling." 

He  asked  the  audience,  "How  many  places  do  we  test  the  same 
thing?"  He  then  tasked  the  audience  to  look  at  test  communications 
to  find  out  who  is  efficient  and  who  is  not.  He  stressed  getting  rid 
of  the  duplicate  sites  and  reducing  the  number  of  people  for  testing 
involvement.  He  stressed  automated  systems.  "Use  computer-aided 
testing  -  make  a  brilliant  tester." 


On  Privitization 

Mr.  Krings  stated  that  the  government  has  limited  license, 
and  that  they  have  to  figure  out  ways  to  make  things  cheaper, 
especially  in  the  testing  arena.  One  of  the  ways  to  do  this  is  to 
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DEPARTMENT  OF  THE  ARMY 
Q+ftct  or  TMt  y»Mi  •('catTAar 
•TAiMIMftrO*.  IX.  MltMtll 

€  January  1988 


MEMORANDUM  FOR:  COMMANDING  GENERAL,  US  ARMY  OPERATIONAL  TEST 

AND  EVALUATION  AGENCY 


SUBJECT*  Scoring  Conferences  and  Data  Collection  Procedures 


The  recent  report  of  the  Defense  Department  Inspector  General 
on  the  subject  of  the  Aquila  Operational  Test  has  identified 
weaknesses  in  our  operational  test  policies  and.  procedures  for  * 
dealing  with  personnel  in  the  employ  of  the  contractor  whose 
system  is  undergoing  test.  These  weaknesses  were  also  identified 
by  the  GAO  in  their  report  of  the  same  operational  test. 

On  9  October  1987  I  provided  oral  guidance  Vo  MG  Drummond 
which  pertained  to  the  discussions  with  contractor  personnel  of 
test  incidents  occurring  in  the  FAADS  LCS-F-H  Test.  That  guidance 
is  reflected  in  two  messages  transmitted  by  CTEA,  copies  of  which 
are  enclosed.  This  policy  guidance  is  to  be  Army  policy  for  all 
scoring  conferences  convened  in  support  of  Array  operational  tests. 

In  addition  to  the  policy  set  forth  in  the  enclosures,  you 
are  to  develop  a  suitable  training  program  for  scoring  conference 
chairpersons.  This  training  program  is  to  be  mandatory. 

Finally,  it  shall  be  our  policy  not  to  utilise  as  data 
collectors  for  operational  tests  any  individual  who  is  an  employee 
of  the  contractor  whose  system  is  under  test. 

Request  you  promulgate  the  above  policy  guidance  to  the  field 
by  message  and  initiate  action  to  Incorporate  this  guidance  in 
Army  regulations  pertaining  to  operational  testing. 


Deputy  Under  Secretary  of  the  Army 
(Operations  Research) 
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DEPARTMENT  OF  THE  ARMY 

UNITED  STATES  ARMY  OPERATIONAL  TEST  AND  EVALUATION  AGENCY 

1*00  COLUMBIA  PIKE 
PALLS  CHURCH,  VIRGINIA  *2041 


CSTE-ZA  (71-3C) 

KSHORAMXJH  FOR:  Mr.  Hollis/  Deputy  Under  Secretary  of  the  Airy  (OR) 

SUBJECT:  System  Contractor  Participation  in  Testing 

*  1.  You  ashed  w  to  get  back  to  you  concerning  CTEA's  and  TEOQM's  views  on 
the  issues  involved  in  applying  the  restrictions  contained  in  Public  Law 
10&-80  on  system  contractor  participation  in  testing. 

2.  Excluding  contractors  from  scoring  conferences#  etc.  (per  attached 
cess age)  is  a  good  step  for  testing  leading  to  full  rate  production.  The 
policy  is  clear#  enforceable,  and  should  not  create  any  problems.  I  have 
discussed  this  policy  with  MG  Dren2  and  he  is  in  general  agreement  as  long 
as  it  is  not  applied  to  earlier  testing.  I  suspect  the  US^F  would  also 
have  problems  here. 

3.  The  public  law  does  present  some  problems  in  the  conduct  of  ICTfcE 
testing  in  the  area  of  logistics  ard  maintenance  support.  For  any  major 
system  where  the  system  contractor  is  not  an  integral  part  of  the 
maintenance  or  support  strategy  for  the  system,  deployed  for  combat,  the 
costs  necessary  to  create  the  military  structure  and  logistics  system  to 
support  the  1OTLE  would  be  prohibitive.  These  costs  are  in  the  form  of 
dollars#  training  and  tirre  to  create  this  support  structure  for  a  system 
that  the  Army  may  not  ultimately  procure. 

4.  The  Army  should  seek  sore  changes  or  waivers  to  the  current  public  law 
that  would  allow  (for  cost  effectiveness  reasons)  system  contractors  to 
provide  specified  types  of  logisitcs  and  maintenance  support  during  the 
oorduct  of  10T*£.  It  seems  prudent  that  the  Army  and  Air  Force  vork  this 
issue  together  to  ensure  that  DCD  obtains  a  workable  change  that  both 
services  can  live  with. 

5.  I  understand  these  Issues  nay  be  referred  to  the  Amy  Test  and 
Evaluation  Connittee  (ATEC)  to  come  up  with  firm  policy  recommendations. 
The  policy  should  be  uniform  across  tie  services  insofar  as  possible  and 
we  should  be  careful  not  to  over  react.  Tie  contractor  is  a  valued  renter 
of  the  development  team  and  his  knowledge  about  the  system  is  important  to 
full  understanding  of  the  system's  performance. 

6.  MG  Drenz  has  concurred  in  this  memo. 


1  Ene  JERCKE  B.  HUMES 

Major  General#  USA 
Commanding 

CF: 

MG  Drenz 
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FACILITIES  AND  INSTRUMENTATION 


T-a 


SARD-RPP 

Subject:  Army  Instrumentation  Test  Suites 


Smart  Munitions  Test  Suite  (SMTS) 


SMTS  will  provide  instrumentation  for  tracking  numerous  small  and 
maneuvering  submunitions,  near  the  ground,  in  clear  air  and  through 
obscurants  to  collect  performance  data  including  pitch  and  yaw.  Smart 
munitions  include  the  SADARM  family  (8  in.,  155mra,  MLRS),  MLRS  TGW  and 
ATOMS  (Block  II). 

Operational  Smoke  Test  Grid  (OSTG) 

The  OSTG  will  provide  instrumentation  to  conduct  force-on- force 
maneuvers  in  a  smoke/obscurant  environment.  This  suite  will  be  used  for 
technical  and  operational  tests  to  include  those  examining  tactics, 
doctrine,  model  validation,  tactical  sensor  system  performance,  etc. 
Thus,  it  will  test  both  friendly  and  enemy  sraoke/obscurant  munitions. 

Stress  Loading  Facility  (SLF) 

The  SLF  will  be  a  movable  set  of  instrumentation  to  test  the 
interoperability  of  communications,  command  and  control  and  intelligence 
electronic  warfare  systems  under  realistic  battlefield  electromagnetic 
environments.  The  instrumentation  will  be  modular  to  complement  the 
fixed  facility  at  the  Electronic  Providng  Ground  and  will  be 
transportable  in  trailers  and  vans  to  tactical  test  sites. 

Funding  Situation:  None  of  the  test  suites  are  in  the  funded 
area  for  POM  90-94.  Candidate  systems  will  be  identified  and  notified 
by  September  1988.  Funding  costs  are  estimated  to  be: 

($  MILLIONS) 


Test  Suites 

FY90 

FY91 

FY92 

FY93 

FY94 

TOTAL 

CATES* 

$  20.0 

20.0 

20.0 

20.0 

20.0 

100.0 

SMIS 

9.0 

23.0 

16.0 

14.0 

8.0 

70.0 

OTSG 

6.8 

8.1 

4.1 

0.6 

0.0 

19.6 

SLF 

9.1 

9.0 

4.0 

3.0 

0.0 

25.1 

$2lC7 


*  CATES  funds  were  constrained  to  $100  M,  total,  with  guidance  to 
augment  existing  instrumentation  within  that  limit. 
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APPENDIX  TO:  FACILITIES  AND  INSTRUMENTATION 


SARD-RPP 
9  March  1988 


Information  Paper 

SUBJECT:  Army  Instrumentation  Test  Suites 

1.  Purpose.  To  provide  status  information  concerning  the  subject  test 
suites  to  the  Army  Science  Board  panel  reviewing  test  and  evaluation. 

2.  Discussion. 

a.  Congressional  reductions  to  institutional  budget  elements 
containing  funds  for  replacing  and  modernizing  test  facility 
instrumentation  were  severe  for  FY86,  87  and  88.  OSD  reduced  the  FY89 
accounts,  accordingly,  that  were  recently  submitted  to  Congress. 

b.  Only  selective  improvement  has  occurred;  consequently,  test 
instrumentation  modernization  has  not  kept  up  with  either  the 
development  of  advanced  technology  systems  or  the  threat  that  new  weapon 
and  support  systems  could  face  on  the  battlefield. 

c.  With  the  approval  of  the  USofA,  ASA(RDA) ,  VCSA  and  Commander, 
AMC,  it  was  determined  that  existing  test  instrumentation  and  that  which 
will  be  acquired  with  institutional  funds  would  be  augmented  in  the  most 
critically  deficient  areas  by  movable  suites  of  test  instrumentation. 
Such  suites  would  be  budgeted  for  by  benefitting  programs  or  whose 
derivative  second  generation  programs  could  benefit. 

e.  A  test  suite  is  a  collection  of  related  instrumentation 
configured  for  technical  and  operational  testing  of  new  technology 
weapons,  systems  or  initiatives  in  specific  areas. 

f.  Four  test  suites  are  being  planned,  the  concepts  have  been 
studied  and  some  prototype  instrumentation  is  being  tested: 

Counter  Air  Test  and  Evaluation  Suite  (CATES) 


CATES  is  designed  to  provide  a  mixture  of  live  and  simulated  targets 
and  threat  simulators  to  test  and  evaluate  the  performance  of  air 
defense  systems.  CATES  will  consist  of  a  movable  combination  of  fielded 
systems,  C3I  systems,  threat  simulators,  instrumentation  (e.g. ,  radars) 
and  data  processing  equipment.  CATES  will  also  be  used  to  test  Army 
aircraft . 


1 — 1 


DISTRIBUTION  LIST 


DISTRIBUTION  LIST 


ADDRESSEE  COPIES 


OSD 

Secretary  of  Defense ,  Pentagon*  Washington*  DC  20301  1 

Under  Secretary  of  Defense  for  Policy*  Pentagon, 
Washington,  DC  20301  #  1 

Under  Secretary  of  Defense,  Acquisition, 

Pentagon,  Washington,  DC  20301  _  1 

Assistant  Secretary  of  Defense  (Atomic  Energy) , 

Pentagon,  Washington,  DC  20301  1 

Assistant  Secretary  of  Defense  (FM&P) ,  Pentagon, 
Washington,  DC  20301  1 

Deputy  Under  Secretary  of  Defense  for  Research 
and  Engineering  (R&AT) ,  Pentagon,  Washington,  DC  20301  1 
Chairman,  Defense  Science  Board,  Pentagon, 

Washington,  DC  20301  1 

Chairman,  Joint  Chiefs  of  Staff,  Pentagon, 

Washington,  DC  20301  1 

Director,  DNA,  6801  Telegraph  Road,  Alexandria, 

VA  22310  1 

Director,  DIA,  Pentagon,  Washington,  DC  20301  1 

Defense  Technical  Information  Center,  Bldg  5, 

Cameron  Station,  Alexandria,  VA  22314  12 

NAVY 

Secretary  of  the  Navy,  Pentagon,  Washington, 

DC  20350  1 

Chief  of  Naval  Operations,  Pentagon,  Washington, 

DC  20350  1 

Commandant,  US  Marine  Corps,  HQS  USMC,  Code  CMC 
Washington,  DC  20380  1 

Under  Secretary  of  the  Navy,  Pentagon, 

Washington,  DC  20350  1 

Assistant  Secretary  of  the  Navy  (RE&S) ,  Pentagon, 
Washington,  DC  20350  1 

Director,  Naval  Research,  Development,  Test  and 
Evaluation,  (OP-098) ,  Pentagon,  Washington,  DC  20350  1 

Deputy  Chief  of  Naval  Operations  (Manpower,  Personnel 
&  Training),  Chief  of  Naval  Personnel,  (OP-01), 
Washington,  DC  20350  1 

Deputy  Chief  of  Naval  Operations  (Plans,  Policy  & 
Operations) ,  (OP-06) ,  Pentagon,  Washington,  DC  20350  1 

Commanding  Officer,  Naval  Medical  Research  and 
Development  Command,  Naval  Medical  Command,  NCR, 
Bethesda,  MD  20814  1 

Naval  Research  Advisory  Committee,  800  N.  Quincy  St., 
Arlington,  VA  22217  1 

Deputy  Chief  of  Staff,  Research,  Development  &  Studies, 
U.S.  Marine  Corps,  HQS  USMC,  Washington,  DC  20380  1 


DISTRIBUTION  (Cont'd) 


ADDRESSEE 
AIR  FORCE 

Secretary  of  the  Air  Force,  Pentagon,  Washington, 

DC  20330 

Chief  of  Staff,  Air  Force,  Pentagon,  Washington, 

DC  20330 

Assistant  Secretary  of  the  Air  Force  (RD&L) , 

Pentagon,  Washington,  DC  20330 
Assistant  Secretary  of  the  Air  Force  (MRA&L) , 
Pentagon,  Washington,  DC  20330 
Deputy  Chief  of  Staff  (Acquisition) ,  (AF/AQ) , 

USAF ,  Pentagon,  Washington,  DC  20330 
Assistant  Chief  of  Staff  (Studies  &  Analysis) ,  USAF, 
(AF/SA) ,  Pentagon,  Washington,  DC  20330 
Commander,  Air  Force  Systems  Command,  Andrews  AFB, 
Washington,  DC  20334 

Air  Force  Scientific  Advisory  Board,  (AF/NB) , 
Pentagon,  Washington,  DC  20330 

ARMY 

Secretary  of  the  Army,  Pentagon,  Washington,  DC  20310 
Under  Secretary  of  the  Army,  Pentagon, 

Washington,  DC  20310 

Deputy  Under  Secretary  of  the  Army  (Operations 
Research) ,  Pentagon,  Washington,  DC  20310 
Assistant  Secretary  of  the  Army  (Research,  Develop¬ 
ment  and  Acquisition),  Army  Science  Board,  Pentagon, 
Washington,  DC  20310 

Director,  Studies  and  Analysis,  Office  of  the 
Administrative  Assistant,  OSA,  (for  Library  of 
Congress),  Pentagon,  Washington,  DC  20310 
Assistant  Secretary  of  the  Army  (Manpower  &  Reserve 
Affairs),  Pentagon,  Washington,  DC  20310 
Chief  of  Staff,  Army,  Pentagon,  Washington,  DC  20310 
Vice  Chief  of  Staff,  Army,  Pentagon, 

Washington,  DC  20310 
Director  of  the  Army  Staff,  Pentagon, 

Washington,  DC  20310 

Deputy  Chief  of  Staff  for  Operations  and  Plans, 
Pentagon,  Washington,  DC  20310 
Assistant  Deputy  Chief  of  Staff  for  Operations  and 
Plans,  Force  Development,  Pentagon,  Washington, 

DC  20310 

Director,  Research  and  Technology,  OASA(RDA), 

Pentagon,  Washington,  DC  20310 
Deputy  Chief  of  Staff  for  Logistics,  Pentagon, 
Washington,  DC  20310 


COPIES 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

5 

20 

9 

1 

1 

1 

1 

1 

1 

1 

1 


E-3 


DISTRIBUTION  (Cont'd) 


ADDRESSEE 


COPIES 


ARMY  (Cont'd) 


Deputy  Chief  of  Staff  for  Personnel,  Pentagon, 
Washington,  DC  20310 

Chief,  MANPRINT  Policy  Office,  Research  &  Studies 
Div.,  ODCSPER,  Pentagon,  Washington,  DC  20310 
Director,  Military  Personnel  Management,  ODCSPER, 
Pentagon,  Washington,  DC  20310 
Director,  Civilian  Personnel,  ODCSPER, 

Washington,  DC  20310 

Comptroller  of  the  Army,  Office  of  the  Secretary  of  the 
Army,  Pentagon,  Washington,  DC  20310 
Chief  of  Engineers,  Pulaski  Building,  20  Massachusetts 
Avenue,  NW,  Washington,  DC  20314 
Deputy  Chief  of  Staff  for  Intelligence,  Pentagon, 
Washington,  DC  20310 

The  Surgeon  General,  Pentagon,  Washington,  DC  20310 
Chief,  Army  Reserve,  Pentagon,  Washington,  DC  20310 
Chief,  National  Guard  Bureau,  Pentagon, 

Washington,  DC  20310 

Chief,  Military  History,  Pulaski  Building, 

20  Massachusetts  Avenue,  NW,  Washington,  DC  20314 
Commander,  US  Army  Medical  Research  &  Development 
Command,  Attn:  SGRD-ZA,  Fort  Detrick,  MD  21701 
Commander,  US  Army  Medical  Research  &  Development 
Command,  ATTN:  SGRD-PLR,  Fort  Detrick,  MD  21701 
Commander,  US  Army  Materiel  Command, 

5001  Eisenhower  Avenue,  Alexandria,  VA  22333 
Commander,  US  Army  Training  and  Doctrine  Command, 

Fort  Monroe,  VA  23651 

Commander,  US  Army  Information  Systems  Command, 

Ft.  Huachuca,  AZ  85613 

Deputy  Commander,  US  Army  Training  and  Doctrine 
Command,  Fort  Leavenworth,  KS  66027 
Scientific  Advisor,  US  Army  Training  and  Doctrine 
Command,  Fort  Monroe,  VA  23651 
Office  Deputy  Chief  of  Staff  for  Combat  Development, 

US  Army  Training  and  Doctrine  Command,  ATTN:  ATCD-GT, 
Fort  Monroe,  VA  23651 

Deputy  Commander,  US  Army  Forces  Command,  Fort 
McPherson,  GA  30330 

Director,  Forces  Management,  US  Army  Forces 
Command,  ATTN:  AFOP-FM,  Fort  McPherson,  GA  30330 
Commander,  9th  Infantry  Division,  Fort  Lewis, 

WA  98433 

Commander,  US  Army  Intelligence  and  Security 
Command,  Arlington  Hall  Station,  VA  22212 
Commander,  US  Army  Communications  Command, 

Fort  Huachuca,  AZ  85613 


1 

10 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

10 

5 

1 

5 

1 

1 

5 

1 

2 

5 

1 


E-4 


DISTRIBUTION  (Cont'd) 

ADDRESSEE  COPIES 


ARMY  (Cont'd) 

Commander,  US  Army  Operational  Test  and  Evaluation 
Agency,  5600  Columbia  Pike,  Falls  Church,  VA  22041  1 

Director,  US  Army  Concepts  Analysis  Agency, 

8120  Woodmont  Avenue,  Bethesda,  MD  20814  1 

Commander,  US  Army  Nuclear  and  Chemical  Agency, 
Washington,  DC  20310  1 

Commander,  US  Army  Foreign  Science  and  Technology 
Center,  220  7th  Street,  NE,  Charlottesville,  VA  22901  1 

Commander,  Missile  Intelligence  Agency,  MICOM, 

Redstone  Arsenal,  AL  35898  1 

Commander,  US  Army  Logistics  Center,  Fort  Lee,  VA  23801  1 
Commandant,  US  Army  Logistics  Management  Center, 

ATTN:  AMXMC-LS ,  Ft.  Lee,  VA  23801-6040  1 

Commander,  US  Army  Research  Institute  for 
Behavioral  and  Social  Sciences,  5001  Eisenhower 
Avenue,  Alexandria,  VA  22333  5 

Director,  US  Army  Research  Office,  P.  0.  Box  12211, 
Research  Triangle  Park,  NC  27709  1 

Director,  US  Army  Human  Engineering  Laboratory, 

Aberdeen  Proving  Ground,  MD  21005  3 

Director,  US  Army  Materiel  Systems  Analysis  Activity, 
Aberdeen  Proving  Ground,  MD  21010  2 

Chief,  National  Science  Center  for  Communications  and 
Electronics,  ATTN:  ATZH-STF ,  Ft  Gordon,  GA  30905-5689  1 

Commandant,  US  Army  War  College,  Carlisle  Barracks, 

PA  17013  3 

Commandant,  US  Army  Command  and  General  Staff 
College,  Fort  Leavenworth,  KS  66027  3 

Commandant,  US  Army  Field  Artillery  and  School, 

Fort  Sill,  OK  73503  1 

Commandant,  US  Army  Chemical  School,  Ft.  McClellan, 

AL  36205  10 

Commander,  Chemical  Research  and  Development  Center, 
Aberdeen  Proving  Ground,  MD  21005  1 

Commander,  Natick  Research  &  Development  Center, 

Natick,  MA  01760  1 

Commander,  Combined  Arms  Center,  Ft.  Leavenworth, 

KS  66027  5 

Commander,  Academy  of  Health  Sciences,  ATTN:  HSA-CDS, 

Ft.  San  Houston,  TX  78234  1 

Commander,  Eighth  US  Army,  APO  SF  96301  5 

Commander,  Western  Command,  Fort  Shafter,  HI  96858  5 

Commander-in-Chief,  US  Army  Europe  &  Seventh  Army, 

APO  New  York  09403  5 

Commander-in-Chief,  US  Army  Southern  Command, 

Quarry  Heights,  Panama,  APO  Miami  34003  5 

Commanding  General,  US  Army  Japan/IX  Corps, 

APO  San  Francisco  96343  ~  5 


DISTRIBUTION  (Cont'd) 

ADDRESSEE  COPIES 

OTHER 

Director,  CIA,  Washington,  DC  20505  1 

Executive  Director,  Board  on  Science  &  Technology 
(BAST),  2101  Constitution  Ave.,  Wash., DC  20418  1 


